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SOME ASYMPTOTIC RESULTS OF GAUSSIAN RANDOM 
FIELDS WITH VARYING MEAN FUNCTIONS AND THE 
ASSOCIATED PROCESSES 



In this paper, wc derive tail approximations of integrals of exponen- 
tial functions of Gaussian random fields with varying mean functions and 
approximations of the associated point processes. This study is motivated 
naturally by multiple applications such as hypothesis testing for spatial 
models and financial applications. 



1. Introduction. Gaussian random fields and multivariate Gaussian random 
vectors constitute a cornerstone of statistics models in many disciplines, such as 
physical oceanography and hydrology ([4, 47]), atmosphere study ([25]), geostatis- 
tics ([21, 22]), astronomy ([51, 32]), and brain imaging ([48, 61, 58, 59]). The dif- 
ficulty very often lies in assessing the significance of the test statistics due to the 
dependence structure induced by the random field. In recent studies, closed form ap- 
proximations of the tail probabilities of supremum of random fields (the p-values) 
have been studied intensively such as in [58, 59, 44]. In this paper, we develop 
asymptotic results of the integrals of exponential functions of smooth Gaussian 
random fields with varying mean functions and the associated point processes. 

For concreteness, let {f{t) : i G T} be a centered Gaussian random field with 
unit variance and living on a d-dimensional domain T C i?''. For every finite subset 
of {ti,...,t„} C T, (/(ti), /(t„)) is a mean zero multivariate Gaussian random 
vector. In addition, let nit) be a (deterministic) function. The main quantity of 
interest is the probability 



where a € (0, oo) is the scale factor. In particular, wc consider the asymptotic regime 
where b tends to infinity and develop closed form approximations of the above tail 
probabilities. We further consider a doubly-stochastic Poisson process {N{A) : A c 
T}, with intensity {X{t) -.teT}. More specifically, let logA(t) = afit) + /i(t) be a 
continuous Gaussian process. Conditional on {X{t) : t S T}, {N{A) : A C T} is an 
inhomogeneous Poisson process with intensity X{t). Note that, conditional on the 
process ,f{t), N{A) is a Poisson random variable with expectation J^e''^^*^~^'^^*^dt. 
Then, we are interested in approximating the tail probability 
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P{N{T) > b). 
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The approximations of tail probabilities in (1.1) and (1.2) are motivated by mul- 
tiple applications such as hypothesis testing for spatial models and financial applica- 
tions; see detailed discussions in Section 2. In fact, (1.1) and (1.2) are asymptotically 
the same. Therefore, the main result of this paper lies in developing approximations 
for (1.1). 

In the statistics literature, closed form approximations of the tail probabilities of 
Gaussian random fields have been widely employed for the computation of p- values 
such as significance levels of the scanning statistics ([50, 48, 44, 7]). The works of [58, 
59, 19] use expected Euler characteristics of the excursion set as an approximation 
and applied it to neuroimaging. [46] used saddlepoint approximation for the tail 
of a smoothed Poisson point process. Using a change of measure idea, [44] derived 
the approximations for non-Gaussian fields in the context of a likelihood-based 
hypothesis test. In the probability literature, the extreme behavior of Gaussian 
random fields is also intensively studied. The results range from general boimds 
to sharp asymptotic approximations. An incomplete list of works includes [36, 38, 
42, 54, 16, 60, 13, 39, 56, 17]. A few lines of investigations on the supremum norm 
are given as follows. Assuming locally stationary structure, the double-sum method 
([45]) provides the exact asymptotic approximation of sup^ f{t) over a compact set 
T, which is allowed to grow as the threshold tends to infinity. For almost surely at 
least twice difFerentiable fields, [1, 57, 6] derive the analytic form of the expected 
Euler-Poicare Characteristics of the excursion set (xi^b)) which serves as a good 
approximation of the tail probability of the supremum. The tube method ([55]) 
takes advantage of the Karhune-Loeve expansion and Weyl's formula. A recent 
related work along this line is given by [44]. The Rice method ([9, 10, 11]) provides 
an implicit description of supj'f{t). The discussions also go beyond the Gaussian 
fields. For instance, [37] discusses the situations of Gaussian process with random 
variances. See also [5] for other discussions. 

The analysis of integrals of non-linear functions of Gaussian random fields is 
less developed compared with that of the supremum. In the case that f{t) is the 
Brownian motion, the distribution of e^^^^dt is discussed by [63, 30]. For smooth 
and homogeneous Gaussian random fields, the tail approximation of Jj,e^^*^dt is 
given by [40] using a technique similar to the double-sum method. The result and 
technique in [40] are restricted to the homogenous fields (with a constant mean). 
In statistical analysis, however, allowing spatially varying mean functions is usually 
very important especially in presence of spatially varying covariates. Meanwhile, 
developing sharp asymptotic approximations for random fields with spatially vary- 
ing means is a much more complicated and more difficult problem. The current 
work substantially generalizes the result of [40] and is applicable to more practical 
settings such as the presence of spatially varying covariates. 

The contribution of this paper is to develop asymptotic approximations of the 
probabilities as in (1.1) and (1.2) by introducing a change-of-measure technique. 
This change of measure was first proposed by [44] to derive tail asymptotics of 
supremum of non-Gaussian random fields. This technique substantially simplifies 
the analysis (though the derivations are still complicated) and may potentially 
lead to efficient importance sampling algorithms to numerically compute (1.1) and 
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(1.2); see [49, 2, 3, 15] for a connection between the change of measure and efficient 
computation of tail probabilities. In addition, without too many modifications, 
one can foresee that the proposed change of measure can be adapted to certain 
non-Gaussian random fields such as those in [44], which uses a change-of-measure 
technique to develop the approximations of suprema of non-Gaussian random fields 
with functional expansions. 

The organization of the rest of this paper is as follows. In Section 2, we present 
several applications of the current study. The main results arc given in Section 3 
with proofs provided in Section 4. Some useful lemmas are stated in Section 5. A 
simulation study and technical proofs of several lemmas are provided as supple- 
mental article [41]. 

2. Applications. The integrals of exponential functions of random fields play 
an important role in many applications. We present a few of them in this section. 

2.1. Hypothesis testing. 

Hypothesis testing for point processes. Consider the doubly-stochastic Poisson pro- 
cess A^(-) with intensity X{t) as defined in the introduction. The mean function of 
the log-intensity is typically modeled as a linear combination of the observed 
spatially varying covariates, that is, 

(2.1) M(t)=x^(t)/3, 

where x{t) = {xi{t), ...,Xp{t))^ . The Gaussian process f{t) is then employed to 
build in a spatial dependence structure by letting log X{t) = f{t) + iJ,{t). This mod- 
eling approach has been widely used in the literature. For instance, [20] considers 
the time series setting in which T is a one dimensional interval, /i(i) in (2.1) is 
modeled as the observed covariate process and f(t) is an autorcgrcssivc process. 
See [26, 18, 64, 23, 24] for more examples of such kind. For applications, this ap- 
proach has been used in many disciplines, such as astronomy, epidemiology, geog- 
raphy, ecology and material scdcnicc!. Particularly, in the epidemiological study, this 
model is used to describe the spatial distribution of positive (e.g. cancer) cases over 
a region T and the latent intensity process is used to account for the unobserved 
factors that may affect the; hazard. 

Under the above assumptions, we consider the related hypothesis testing prob- 
lems admitting a (simple) null hypothesis that the point process has log-intensity 
/(t)+x^(i)^ with l3 and the covariancx! function known. The alternative hypothesis 
could be any probability model under which the distribution of N{T) stochastically 
dominates the one under the null hypothesis. The one-sided p-value is then given 
by 

(2.2) P{N{T) > b), 

where b is the observed count. This is equivalent to testing that a region T is of a 
higher hazard level than the typical (null) level. 

For concreteness, we consider one situation that is frequently encountered in 
epidemiology. Let the process N{-) denote the spatial locations of positive asthma 



4 



LIU AND XU 



cases in a certain region T such as the New York City metropolitan. We assume 
that N{-) admits the doubly-stochastic structure described previously. To keep 
the example simple, we only include one covaraite in the model, that is, log \{t) = 
/3o + /3\x{t), where x{t) is the pollution level at location t and has been standardized 
so that jrj,x{t)dt = 0. Suppose that f3i is known or an accurate estimate of (3i is 
available. One is interested in testing the simple hypothesis Hq : = (3q against 
H\ : > where /3q is the national- wise log-intensity. A value is given by 
P{N{T) > 6). In this case, it is necessary to consider a spatially varying mean of 
the log-intensity to account for the inhomogeneity given that regression coefficient 
/3\ for pollution level is nonzero under the null hypothesis. 

For other instances, the spatially varying covariatcs arc sometimes chosen to 
functions to reflect certain periodicity. One such case study is discussed in [64] 
and further in [26] under the time series setting. In that example, positive cases 
of poliomyelitis in the U.S.A. for the years 1970 - 1983 were observed. The time- 
varying covariates x(i) are set to be a linear trend and harmonics at periods of 6 
and 12 months and more precisely 

fj.{t) = x(t)^/3, x{t) = (1, t, cos(27rf/12), sin(27rf/12), cos(27rt/6), sin(27rt/6)), 

where t is in the unit of one month. Similar hypothesis testing problems to the 
asthma case may be considered. The coefficients for most terms are significantly 
non-zero. Thus, spatially varying covariatcs arc ubiquitous in practice, which results 
in an non-constant mean under the null hypothesis. 

In order to apply the results in this paper to a composite null hypothesis, such 
as the case in which the covariancc function of f(t) is unknown, we need the cor- 
responding estimates for some characteristics of the covariance function of / (see 
Theorem 3.4). The uncertainty of these estimates will definitely introduce addi- 
tional difficulty of the p-value calculation. On the other hand, with reasonably 
large sample size, the necessary parameters can be estimated accurately. In addi- 
tion, the approximations stated in later theorems only consist of the derivatives 
of the covariancc function (cquivalently spectral moments) and /i(f) at the global 
maximum. Then, one can design estimators simply for these distributional charac- 
teristics, which are much easier to estimate than the entire covariance functional 
form. There are extensive discussions on the estimations of spectral moments both 
parametrically and nonparametrically such as in the textbook [53]. This plug-in- 
estimate strategy is used by [59] to handle such a composite null hypothesis com- 
bined with a closed form p- value approximation by means of the expected Euler 
characteristics. In that paper, the authors estimate and plug in the estimate of the 
Lipschitz-Killing curvature to the expected Euler characteristic function to approx- 
imate the tail probability of the suprcmum of a f-ficld. Given that the main focus 
of this paper is on developing the approximations for the tail probabilities, we do 
not pursue parameter estimation aspects. 

Hypothesis testing for aggregated data. The tail probability of / e'^^*^~^^^*^dt itself 
can also serve as a p-valuc. In environmental science, the ozone concentration fluc- 
tuation is typically modeled to follow a log-normal distribution. For instance, it is 
found that the hourly averaged zone concentration typically admits a log-normal 
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distribution; see [34]. We let logA(i) = ii{t) + f{t) be the log-concentration of ozone 
at location t. One is interested in testing whether a region T has an unusually high 
ozone level, that is, Hq : E{\ogX{t)) = ii{t) and Ha : E{\ogX{t)) > X{t) for t € T. 
Similar to the previous motivating example, in a regression setting, one may model 
fj.{t) — f3o + x^(t)/3 and consider Hq : f3o = /3q and Hi : /3q > /Sq. One may reject 
the null if the observed aggregated ozone level, b, in region T is too high and a 
f)- value is given by 



A similar argument as that for the point process application applies for the necessity 
of incorporating a non-constant mean function ^{t) to reflect spatial inhomogeneity 
such as spatially varying covariates and periodicity. 

2.2. Financial applications. The integrals of exponential functions also play 
an important role in financial applications. This is more related to the applied 
probability literature. In asset pricing, the asset price indexed by time t is typically 
modeled as an exponential function of a Gaussian process, that is, S{t) = e-^^'K For 
instance, the Black-Scholes-Merton formula [14, 43] assumes that the price follows 
a geometric Brownian motion. Then, the payoff of an Asian option is the function 
of the averaged price e^^^^dt and (1.1) is the probability of exercising an Asian 
call option. 

In the portfolio risk analysis, consider a portfolio consisting of n assets {Si, Sn) 
each of which is associated with a weight (e.g. number of shares) {wi, w„). One 
popular model assumes that (logs'!, log ^n) is a multivariate Gaussian random 
vector. The value of the portfolio, S = J2^=i ^iSi, is then the sum of correlated 
log-normal random variables (see [29, 8, 12, 31, 28]). Without loss of generality, we 
let ^ = n. 

One typical situation is that the portfolio size is large and the asset prices are 
usually highly correlated. One may employ a latent space approach used in the 
literature of social network. More specifically, we construct a Gaussian process 
{f{t) : t & T} and associate each asset i with a latent variable ti G T so that log Si = 
f{ti). Then, the log asset prices fall into a subset of the continuous Gaussian process. 
Further, there exists a (deterministic) process w{t) so that w(ii) = Wi. Then, the 
total asset one unit share value of the portfoho is ^ '^wiSi = ^ Yli'^iU)^^^^^^ ■ 

In this representation, the dependence among two assets is determined by \ti—tj\, 
which indicates the economical distance between two firms. For instance, if firm i 
is the supplier of firm j then ti — tj tends to be small. The spatial index t may also 
include other social-economical indices. This latent space approach has become 
popular in recent social network studies. For instance, [35] considers a graph of 
n nodes. The authors associate each node i with a spatial latent variable U and 
model the probability of generating an edge between two nodes {i and j) in a graph 
as a logistic function of \ti — tj\. Similar latent space models that project nodes 
onto a latent space can be found in [33] . Other approaches to represent interactions 
among variables via latent structures have been used; see, for instance, [62, 52] and 
references therein. 
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In the asymptotic regime that n ^ oo and the correlations among the asset 
prices become close to one, the subset {U} becomes denser in T. Ultimately, we 
obtain the limit 

1 " f 

where h{t) indicates the limiting spatial distribution of {ti} in T. Let ii{t) = 
logw{t) + \ogh{t). Then the tail probability of the (limiting) unit share price is 

P (^j e^W+''(*)dt > . 

It is necessary to include a varying mean in the above representation to incorporate 
the variation of the weights assigned to different assets and the inhomogeneity of 
the limiting distribution of tj's. 

3. Main results. 

3.1. Problem setting. Consider a homogeneous Gaussian random field {f{t) : 
t & T} living on a domain T c R^. Let the covariance function be 

C{t-.s) = Cov{f{t),f{s)). 

We impose the following assumptions: 
CI / is homogenous with Ef{t) = and Ep{t) = 1. 

C2 / is almost surely at least three times differentiable with respect to t and 

C3 T is a d-dimensional Borel measurable compact set of i?'' with piecewise 
smooth boundary. 

C4 The Hessian matrix of C{t) at the origin is —7, where I is the dx d identity 
matrix. 

C5 For each t & R^, the function C{Xt) is a non- increasing function of A e i?"*". 
C6 If ^i{t) is not a constant, the maximum of fi{t) is not attained at the boundary 
of T. 

Let A''(-) be a point process such that conditional on {f{t) : t G T}, iV(-) is dis- 
tributed as a Poisson process with intensity X{t) = e'^^*^~^'^^^*\ For each Borel 
measurable set A cT, let 

(3.1) IiA)= [ e''(*)+<^-^Wdt. 

J A 

Throughout this paper, we are interested in developing closed form approximations 
to 

(3.2) p(^J e'^(*)+<^^(*)di > 6^ , and P{N{T) > b) 



as 6 ^ DO. 
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Remark 3.1. Condition CI assumes unit variance. We treat the standard de- 
viation a as an additional parameter and consider J e^^*''^~^'^^'^^^dt. Condition C2 
is rather a strong assumption. It implies that C{t) is at least 6 times differen- 
tiable and the first, third, and fifth derivatives at the origin are all zero. Condi- 
tion C3 restricts the results to finite horizon. Condition C4 is introduced to sim- 
plify notations. For any Gaussian process g{t) with covariance function Cg{t) and 
ACg(O) = — S and det(S) > 0, C4 can be obtained by an affine transformation by 
letting g{t) = f{T}/H) and 

Jt J{s:E-i/2seT} 

where for each positive semi-definite matrix E we let Y}!"^ be a symmetric matrix 
such that = Conditions C5 and C6 are imposed for technical reasons. 

Remark 3.2. The setting in (3.2) also incorporates the case in which the in- 
tegral is with respect to other measures with smooth densities with respect to the 
Lebesgue measure. Then, if v{dt) = K{t)dt, we will have that 

J A J A 

which shows that the density can be absorbed by the mean function as long as K{t) 
is bounded away from zero and infinity on T. 

Remark 3.3. The results presented in the current paper are directly applicable 
to some of the applications in Section 2 such as the approximation of p-value for 
simple null hypothesis. Some conditions required by the theorems may need to be 
relaxed to reflect practical circumstances for other applications. Nonetheless, the 
current analysis forms a standpoint of further study of more general cases. 

3.2. Notations. To simplify the discussion, we define a set of notations con- 
stantly used in the later development and provide some basic calculations of Gaus- 
sian random field. Let "9" denote the gradient and "A" denote the Hessian matrix 
with respect to t. The notation "9^" is used to denote the vector of second deriva- 
tives. The difference between d'^f{t) and Af{t) is that A/(t) is a d x d symmetric 
matrix whose diagonal and upper triangle consists of elements of d'^fit). Similarly, 
we will later use z (and z) to denote the matrix version of the vector z (and z), 
that is, z (and z) is a symmetric matrix whose upper triangle consists of elements 
in the vector z (and z). Further, let djf{t) be the partial derivative with respect to 
the j-th element of t. We define u as the larger solution to 

Note that when b is large, the above equation generally has two solutions. One is 
on the order of log 6; the other one is close to zero. We choose the larger solution 
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as our u. Lastly, we define the following set of notations 

= ~{d,c{t),...,ddC(t)), 

Ii2{t) = (dlC{t),i = l,...,d;dlC{t),i = l,...,d-l,j = i + l,...,d), 

M02 = M20 = M2(0). 

It is well known that (c.f. Chapter 5.5 of [6]) (/(O), ^^/(O), 5/(0), /(t)) is a 
multivariate Gaussian random vector with mean zero and covariance matrix 

/I ^l2^ C{t) \ 
0/ nJ{t) 

V c(t) ^l2{t) ^H{t) 1 / 

where the matrix /X22 is a d{d + l)/2-dimensional positive definite matrix and con- 
tains the 4th order spectral moments arranged in an appropriate order according 
to the order of elements in 9^/(0). Define 

(3.3) r = M V 

V '"02 M22 J 

For notation convenience, we write a„ = 0(6„) if there exists a constant c > 
independent of everything such that a„ < c6„ for all u > 1, and a„ = o(6„) if 
du/bu — >^ as w — >■ 00 and the convergence is uniform in other quantities. We write 
flu = 0(&u) if du = 0{bu) and 6„ = 0(a„). In addition, we write X„ = Op(a„) if 
Xu/o^u ^ as u — > 00 and E^^'^^""" — > 1 imiformly for 6 over a compact interval 
around the origin. Similarly, wo define that X„ = Op(a„) if E^'^"^"'^ is bounded 
away from zero and infinity for all u € and ^ in a compact interval around zero. 
We write a„ ~ 6„ if o„/6„ ^ 1 as u ^ 00. 

3.3. The main theorems. The main theorems of this paper are presented as 
follows. The following theorem is the central result of this paper whose proof is 
provided in Section 4. 

Theorem 3.4. Consider a Gaussian random field {f{t) : t G T} living on a 
domain T satisfying conditions Cl-6. Let I{T) be as defined in (3.1). Then, 

P{I{T) > 6) ~ u'^-'l^e^P |_ (^-/i.(t))^ | _ H^^^^^t^^t^ 
as b ^ 00, where 

(3.4) /x<,(i) =Mt)/a, 



u is the larger solution to 



f2n\ 2 d „„ , 
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H{ij,, a, t) is defined as 



\r\-i 



(<i+l)(d+2) 



(2^) 



exp 



I l^M22l 



exp < -- 



80-2 



1 — Af20At22^M02 



+ 



2(7 



l/2i 
'^22 2cr 



+ \dl^At)\' 



dz, 



and 



1 = (1^, ) . 

d d(d-l)/2 

Corollary 3.5. Under the conditions of Theorem 3.4, if l^{t) has one unique 
maximum in T denoted by , then 

P{I{T) >b)^ (27r)'^/2det(A/.<,(f,))-V2^(^,a,t.)t.''/2-ig^p|_(!i^i|M!| . 



Proof of Corollary 3.5. The result is immediate by expanding /^^(t) around 
up to the second order. □ 



Theorem 3.6. Assume that the Gaussian process f{t) satisfies the conditions 
in Theorem 3.4- Consider a point process {N{A) : A G B(T)}, where B{T) denotes 
the Borel subsets of T. Suppose that there exists a process log X{t) = n{t) + (jf{t) 
such that given {X{t) : t G T}, N{-) is a Poisson process with intensity X{t). Then, 

P{N{T) > 6) ~ P(/(T) > b) 

as b ^ 00. 

Proof of Theorem 3.6. We prove this approximation from both sides. For 
£ > small enough, we have that 

(3.5) P {N{T) >b) > P [n{T) > b ; I{T) > b + ^^Z^+e^ 

= (l + o(l))p(/(T) > 5 + 61/2+^) 
= (l + o(l))P(/(T) >&). 

The second step is due to the fact that conditional on I{T) 

in distribution as I{T) 00. Therefore, we obtain that 

P (^N{T) > b I 7(T) >b + 6^/2+^) 1. 
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Together with the fact that 

P (^N{T) > b ; /(T) >b + 6l/2+e j = p j^^^y) > ^ I J^y) > ^ ^ 6l/2+e j p J^j^y) > ^ ^ fei/z+e j ^ 

wc obtain the second step of (3.5). The last step that P(/(r) > b + = 
(1 + o(l))P(/(T) > 6) is a direct application of Theorem 3.4. For the upper bound, 

we have that 

P{N{T)>b) = P{N{T)>b: I{T)>b-b^-^)+P{N{T)>b; I{T)<b-b^-^) 
< (1 + o(l))P (/(T) >b) + P {N{T) > b I I{T) = b - b^-') 
= (l + o(l))P(/(r)>6). 

The last step uses the fact that 

P {N{T) > b I I{T) = b - b^-') < exp {-(1/2 + o{l))b^-^^} = o{l)P{I{T) > b). 

The bound of the tail of a Poisson distribution can be derived by the standard 
technique of large deviations theory [27] and therefore is omitted. □ 



Remark 3.7. The result in Theorem 3.6 suggests that an observation of a large 
number of points in a region T is mainly caused by a high level of its underlying 
intensity. Technically, this is because the distribution of N(T) can be roughly con- 
sidered as a convolution of the distribution of J e^^*^dt and a Poisson distribution. 
Note that J e^^^^dt is approximately a log-normal random variable, which has a 
much heavier tail than that of a Poisson random variable. Therefore, the tail be- 
havior of N{T) is mostly dominated by the tail of its underlying intensity. 

3.4. The change of measure. In this subsection, we propose a change of measure 
Q which is central to the proof of Theorem 3.4. Let P be the original measure. The 
measure Q is defined such that P and Q are mutually absolutely continuous with 
the Radon-Nikodym derivative being 

«^ dQ_f 1 e^p{-l{f{t)-u + f,,{t)f} 

^•"■"^ dP hmes{T)' exp{-l/(i)2} 

where mes(-) denotes Lebesgue measure. This change of measure is first proposed by 
[44] to derive the high excursion probabilities of approximately Gaussian processes. 
It is more intuitive to describe the measure Q from a simulation point of view. In 
order to simulate f{t) under the measure Q, one can do the following two steps: 

1. Simulate a random variable r uniformly over T with respect to the Lebesgue 

measure. 

2. Given the realized r, simulate the Gaussian process f{t) with mean [u — 
IJ'a{T))C{t — t) and covariance function C{t). 
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It is not hard to verify that the above two-step procedure is consistent with the 

Radon-Nikodym derivative in (3.6). The measure Q is designed such that the dis- 
tribution of / under the measure Q is approximately the conditional distribution 
of / given Jj,e^^*^dt > b under the measure P. Under Q, a random variable r is 
first sampled uniformly over T, then /(t) is simulated with a large mean at level 
u — /Xct(t). This implies that the high level of the integral Jj, e^(*^+'^-^*^*)df is mostly 
caused by the fact that the field reaches a high level at one location t* and such a 
location t* is very close to r. Therefore, the random index t localizes the maximum 
of the field. In particular, one can write the tail probability as 



e>^W+^fWdt>b] = 





dP f 




dQ' Jrp 



^m+^m^t > b 



where we use to denote the expectation under Q and E to denote that under 
P. 

In what follows, wc explain the main result in Theorem 3.4 and how the change 
of measure helps in deriving the asymptotics. To simplify the discussion, we proceed 
by assuming that iJ,{t) = and a = 1. Upon considering zero (constant) mean, we 
obtain from the result of Theorem 3.4 that P(Jj, e^^^Ut > b) = e(l)P(sup-r f{t) > 
u) (c.f. [6]). This suggests that the large value of the exponential integral at the level 
b is largely caused by the high excursion of sup^^ f{t) at a level u. The conditional 
distribution of f{t) given a high excursion at level u (the Slepian model) is well 
known ([7]). We proceed with a rough mean calculation. Suppose that f{t) attains a 
large value at the origin of level u. Then the conditional field will have expectation 
E[f{t)\f{0) = u] = uC{t). We expand the covariance function as 



t\ 



uC{t) « u - 

Therefore, one may expect to choose u such that conditional on /(O) = u 



(3.7) / e^Wdi « / e"-tl*l'dt = u-^l\^ = b. 

Jt Jr'' 

This is precisely how u is selected in Theorem 3.4. The above calculation ignores the 
higher order expansions of C{t) and the deviation of the conditional field from its 
expectation. It turns out that these variations do not affect the asymptotic decaying 
rate of the tail probability. They only contribute to the constant term. 



4. Proof of Theorem 3.4. The proof of Theorem 3.4 requires several lemmas. 
To facilitate the reading, we arrange their statements in Section 5. 

Note that 



= E"^ 



dP 
dQ 
1 



X mes{T) 



eQ 



dP 
dQ 



(.t)+'^mdt > b 



dr. 
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Furthermore, we use the notation that E^[-] = £"5[-|r]. For each r, we plug in (3.6) 
and further write the expectation inside the above integral as 



(4.1) 



dP 

dQ' jt 



mes{T)E^ 



= mes(T)e"'/2£;^ 

We write 

(4.2) A(r) = e^'/^E^ 



/Wdi > b 



^Kt)+^mdt > b 



1 



Note that conditional on r, for every set A, 

(4.3) Q (/(•) e A|t) = p(/(.) + iu- fiAT))Ci- - r) e a) , 

that is, the conditional distribution of f{t) (given r) under Q equals to the distri- 
bution of f{t) + {u — (r))C(f — t) under P. This equivalence can be derived from 
the two-step simulation procedure in Section 3.4. Therefore, we can simply replace 
f{t) by f{t) + {u — iJa{T))C{t — r), replace Q by P, and write 



A(r) = e"'/^^; 



J^p(«-M.(t))[/(t) + («-M,.(T))C(<-r)+A<„(t)] + iMj(t)^^' 



(4.4) 
Let 

(4.5) 

(4.6) 



X 



g<T{/(t) + («-M<,(T))C(f-T)+/.„(t)}^^ ^ ^ 



K 



g<^{/(t)+(«-A*<r(t))C(t-r)+/n<,(t)}^^ ^ J, I 

(«^(*))[/(t) + ("-/'a(r))C(t-r)+/i<,(t)] + i/.= (t)^^_ 



Then, (4.4) can be written as 
(4.7) 

A(T) = e«'/2y E[K-^-£^\f{T)=w,df{T)=y,d^f{T)=z] x h{w,y,z)dwdydz, 

where h{w, y, z) is the density function of (/(r), df{T), d'^f{T)) evaluated at {w, y, z). 

For a given S' > small enough, wc consider two cases for t: first, {t : \t — 
t\ < } C T and otherwise. For the first situation, r is "far away" from 

the boundary of T, which is the important case in our analysis. For the second 
situation, t is close to the boundary. We will show that the second situation is of 
less importance given that the maximum of ii{t) is attained at the interior of T. 

For the first situation, the analysis consists of three main parts. 
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Part 1 Conditional on (r, f{T),df{T), i9^/(t)), we study the event 
(4.8) = {/ e<^^/W+("-''<'(^»^(*-^)+''<'(*)>(it > , 

and write the occurrence of this event almost as a deterministic function of 
/(r), 9/(r), and d^ir). 

Part 2 Conditional on {t, f{T),df{T),d'^ /{t)) , we write K defined in (4.6) as a 
function of /(r), df{T), d'^f{T) and a small correction term. 

Part 3 We combine the results from the first two parts and obtain an approxima- 
tion of (4.1) through the right-hand-side of (4.7). 

All the subsequent derivations are conditional on a specific value of t. 

Preliminary calculations. For < s < S' sufficiently small, let 

(4.9) 

Cq = {|/(r) -u + ^i,{T)\ < \dfir)\ < \d^f{r) - {u - m.(t))mo2| < u'/^+'} , 

According to Lemma 5.2, we only need to consider the integral on the set £q, that 
is. 



^ . / e^^*^+''f'^*Ut >b Cn 

Je^p{{u-fiAmf{t) + nAt)) + hf^Ut)}dt'JT ' 



eQ 

The above display equals to 



where 

(4.10) C = {|/(t)| < \df{T)\ < «V2+e^ \02f^^^\ < „l/2+e| ^ 

corresponds to £q under the transform (4.3). Therefore, throughout the rest of the 
proof, all the derivations are on the set jC. Note that the sets jCq and £ depend on 
T and u. Since all the subsequent derivations are for specific r and u, we omit the 
indices of r and u in the notations £ and £q. 

We first provide the Taylor expansions for f{t), C{t), and fi{t). 

• Expansion of /(i) given (/(r), ^/(t), ^VW) • Let t-T = ((t-r)i, {t-T)d). 
Conditional on i^f {t) , d f {t) , f {t)) , we first expand the random function 



(4.11) fit) = E[m\f{r),df{T),dy{r)]+g{t-r) 

= m + dfirYit -T) + \{t- rfAf{T){t - t) 
+93{t - r) + Rf{t - r) + g{t - r) 



where 



9s{t -r) = WE ,/(r)|/(r), d f {r) , f (r)] {t - r^t - r^t - r)^. 



6 • 
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Note that dfji.f{T) is independent of (/(r), A/(r)) and 

E [d!^J{r)\f{T),df{T),d'f{r)] =-Y,dUcmfi.r). 

I 

git) is a mean zero Gaussian random field such that Eg^{t) = 0{\t\^) as 
i — >■ 0. In addition, the distribution of g{t) is independent of t, /(t), df{T), 
and d'^fir). Rf{t — r) = 0{\t — t\^) is the remainder term of the Taylor 
expansion of E [/(i)|/(r), ^/(t), ^^/(r)] . 

• Expansion of C{t): 

(4.12) C{t) = l-^t'^t + C4{t) + Rc{t), 
where Rc{t) = 0{\tf) and 

ijkl 

• Expansion of iJ,{t): 

(4.13) (t) = /ia (t) + dfi, (r)^ (t - r) + i (t - A^i„ (r) (t - r) + i?^(t - r) , 

where i?^(f - t) = 0(1^ - rf). 

Let J be the d x d identity matrix. We define the following notations that will 
be constantly used later, 

u = u-Hair), y = df{T), z = A/(r), 
y = df{T)+d^ji„{T), z = A/(T)+M<,(T)7 + AM,(r), 
R{t) = Rf{t) + {u-tx„{T))Rc{t) + R^{t). 

As mentioned earlier, we let z and z be the vector version of the matrices z and z. 
Now, we start to carry out our three-step program. 

Part 1. All the derivations in this part are conditional on specific values of r, 
/(r), a/(r), and ^^/(r). Define 

We insert the expansions in (4.11), (4.12) and (4.13) into the expression of /i and 
obtain that 

h = j^^^e^v[o f{T) + df{T)'{t-T) + \{t-T)'M{r){t-T)+gs{t-T) 
+Rfit-T)+g{t-T) 

+ {u- /x.(r)) (^1 - ^{t - T^it - r) + C4(t - r) + Rc{t - r)^ 
(4.14) +^^(r)+aMa(T)^(t-T) + ^(i-r)^AM,(r)(i-r) + i?^(t-r) jrft. 
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We write the exponent inside the integral in a quadratic form of {t — r) and obtain 
that 

h = exp|(TU + £7/(T) + |y"^(M7-z)"^y| 

exp - {ul - zr'yViuI - z) (,s - {ul - z)-'y) } 



(4.15) 



X exp {aga (t) + a{u- /x<^(r))C4 {t) + aR {t)} x exp {ag (t)} dt 



Further, consider the change of variable that s = {ul — z)^/^(t — r), write the big 
integral in above display as a product of expectations and a normalizing constant, 
and obtain that 

/i = det(M/ - z)"^/^ exp |(TM + (t/(t) + ^^^(■u/- z)"^y| 

x[ , e^p(-Us-{uI-z)-'/^yY (s-{uI-z)-'/^y)\ds 

J(ul-Z)-2S + T(^T I ^ ^ ^ ^ 

exp jcrgs (^{ul - z)"5S'^ + a{u - /Xct(t))C4 ((mI - z)"*^^ + aR (^{ul - z)" 



xE 
xE 



exp jo-ff ((mI - z) 2 5^1 



The two expectations in the above display are taken with respect to S and S given 

the process g{t). S* is a random variable taking values in the set {s : {ul — z)~^/^s + r e T} 

with density proportional to 

exp - {ul - z)-V2y)^ - {ul - z)-'/^y) | 

and ^ is a random variable taking values in the set {s : {ul — z)~^/^s + r G T} 
with density proportional to 

exp - {ul - zr'/^yY (s - {ul - z)-'/^y) | 

X exp jcrgs (^{ul - z)~5s^ + a{u - /Uo-(t))C4 (j^uI - z)~5s^ + aR (j^ul - z)~is 
(4.16) 

Together with the definition of u that 

d/2 



9-77 \ "'^ 



we obtain that 
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if and only if 

/i = det(M/ - z)"^/^exp |crM + (t/(t) + - z)"^y| 

x[ ^ e^pLUs-iuI-zy'/^yV (s-{uI-z)-'/^y)\ds 

x£;exp|(T53 ((m/-z)-5S') +a{u- ii^{t))C^ {{uI - t.)- + cri? ((uJ - z)-?^) | 
X exp{-M~^^„} 



d/2 

> I — I U 



(4.17) 

where 

(4.18) e« = -wlog {i^exp [ag ((w/ - z)-!^)] } . 

We take log on both sides and plug in the result of Lemma 5.4 that handles the big 
expectation term in (4.17). Then, the inequality (4.17) is equivalent to 

A = <^f{r) + ^y'^iul - z)-^y - ^ logdet(7 - w'^z) +aB + o{u-^) > u-^^u, 

(4.19) 

where 

(4.20) B A -^(«-^y + l/a)V2.(.-^F + 1/a) + + E ^t^uCiO), 

i 

and 

Y = {yf,i = l,...,d;2yiyj,l<i<j<d}, 1 = (1^, 0^)^. 

d d(d-l)/2 

Roughly speaking, according to Lemma 5.3, the event £f, is the same as the event 

{A > Op(«-3/2+3^)}. 

Part 2. Similar to Part 1, all the derivations in this part are conditional on 
(t, f{T),df{T),d'^f{T)). We now proceed to the second part of the proof. More 
precisely, we simplify the term K defined as in (4.6) and write it as a deterministic 
function of (/(r), df{T), d^f{T)) with a small correction term. For e < S < S' with 
all of them sufficiently small, we let A„ = u~^^^^^. We first split the integral into 
two parts, that is, 

K = I e(""'*<'W)[-''W + ("-/'<.(-r))C(t-r)+;i<,(t)] + iM^(t)^^ 



/ 

J\t-T\<\u J\t-T\>\^ 

h + h- 
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For the leading term, note that \t — t\ < \n = u ^/^+^. We insert the Taylor 
expansion of lJ,a{t) 

= f e{u-n^{t))[fit)+iu-n^{T))C{t-T)+n^(t)] + ^fil{t)^^ 

J\t-T\<Xn 

= (1 + o(l))e"^~"''''''^'"'"5i"'^'^^ / g(«-/^<^(t))[/(*)+("-/^<'(-^))C(*-'r)-"+;*<TW](^^_ 

J|t-T|<A„ 

Let Cm — 0{u~^^'^~^^). In what follows, we insert the expansions in (4.11), (4.12), 
and (4.13), write the exponent as a quadratic function of t — r, and obtain that on 
the set jC 

I ^{y-^t„{t))[f{t)+(u-^l^{T))C{t-T)-u+^l^{T)]^^ 

J\t-r\<\u 



fir) + {t- T^y - i(i - rfiul - z){t - r) 



j 

J\t-T\<X^ 

+gs{t - r) + uC^t -r)+git-r) + (u-'/^+^') | 
(1 + 0(1)) exp |(u + C„) (/(r) + ^y'^iul - z)-^y^ | 



dt 



X / exp< (u + Cu) 

J\t-T\<K I 

+53 (t - r) + uC\it -r)+g{t-T)+0 (u-^/^+^') | 



-\{t-T-{uI- i)~^yf iul -i){t-T-{uI- z)-^ 



(4.21) 

We consider the change of variable that s = {u + QuY^'^iuI — ^Y^'^{t — T) and obtain 
that (4.21) equals to 

(1 + o(l))det(«/ - z)-V2^-<i/2 exp |(ti + C„) (/(r) + \f {ul - i)-^y 



X / exp |-i s - (^i + CuY'^uI - z)-'/^y 

J|«-l/2(ii/_z)-l/2s|<A„ I ^ 

X exp|(w + C„)53 {{u + Cu)-^^\ul - z)-V2s) + u{u + C„)C4 [{u + C«)-'/'(«/ - z) 
+(ti + Cu)9 {{u + Cu)-^'\ul - z)-i/2s) jds. 



(4.22) 



Note that the variation of the last term in (4.22), the g{t) term, is tiny. Then, we 
first focus on the leading term. Similar to the proof of Lemma 5.4, we can write the 
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integral (without the g{t) term) as 



X expj + Cu)93 {{u + W^'^{ul - z)-^/'s) 

+ u{u + Cu)Ci ((n + C«)"'/'(w/ - jds 

= (l + o(l))e-^^^^^^^ 



ds, 



|«-l/2(ii/_z)-l/2s|<A„ 



where 



Y= {y1,i = l,...,d;2y,yj,l<i<] < rf} , 
is arranged in the same order as that of the elements in Y. Therefore, (4.21) equals 



/ 



(1 + o(l))det(w/ - z)-i/2u-<^/2 exp {u + C„) /(r) + -f{ul - i)-^y - fi22Y 



exp |s - (« + Cu)'/\ul - z)-V2^|'| 



ds 



xE 



|ii-l/2(S/_g)-l/2s|<A, 

exp {(^i + C„)5 ({u + Cu)-"^{ul - ~z)-^'^S') } 
(4.23) 



where S' is a random variable taking values on the set {s : \u ^^"^{ul — z) ^/^s| < A„} 
with density proportional to 



exp [-l\s-{u + CuY'^{uI - z)-i/2y|'| 
X exp {(u + Cu)93 [{u + Cu)~^'^{ul - z)-i 



-^{u + Cu)Ci ((« + C«)-'/'(«/ - z)-i/2.s) } 



We use K, to denote the last two terms of (4.23) 



|«-l/2(fi/_i)-l/2s|<A„ 



exp 



{u + CuY/\uI-i)-^'^y^^ds 



xE 



exp {(« + C„)5 ({u + Cu)-"\ul - z)-i/25') } 



(4.24) 



It is helpful it keep in mind that k = (2??)'^/^ + o(l). Now, we continue the calcu- 
lations in (4.23) and write (4.21) in the form of A defined as in (4.19) to facilitate 
the change of variable later. Then, on the set £, we plug in the form of A and B 
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1 



„~,-2 



(4.21) = (1 + o(l))«det(«7 - ~7)-'l'u-''l' exp |(u + U) \fij) + -y ' {ul - z)-'y - —Y ' 
= (1 +o(l))ACM"''expi + ;^logdet(7- w"^z) 

(7 2(7 

+ ^ [y^iul - z)-iy - y^iul - z)-'y) + u-'/^+'O + /(r)) 

= {1 + o{1))ku-'^ exp\-A - uB - ^Tr{z + ii^{t)I + Aii„{t)) 

la 

-fdi,,{T) - ^|9/x.(t)|2 + n- Wo + \z\^ + /(t))|, 
(4.25) 

where Tr(z) is the trace of matrix z. The last step in the above display is thanks 
to Lemma 5.6 and the fact that y = y + 9/Uct(t). We insert the result of (4.25) to 
the definition of I2 and obtain that 

72 = (l + o(l))«;M-''e"'-"'^<'(^)+5^'(^) 

X expj -A-uB- ^Tr{i + h„{t)I + A/x^(r)) - y^dn^ir) - l\dn„{T)\'' 
I a za I 



+«-wo(M^ + N^ + /(r))|. 



Thanks to Lemma 5.5, J3 is of a much smaller order than l-i and we obtain that 
K = I2+I3 

= (l + o(l)) (^K; + o(e-^*"'^''e"™Pl9(*)l)) w-'^e"'-"'^''(^)+5'^'(^) 

X expj -A-uB- ^Trii + n^ir)! + A/i<,(T)) - f dn^ir) - ]:\^^ia{T)\'' 
I (T la I 



(4.26) +u-'/^+'0{\y\^ + \z\^+f{T))^. 



Part 3. Use the notations that /(r) = w, df{T) = y, and d'^f{T) = z. We now 
put together the results from Part 1 and Part 2 and obtain an approximation of 
A(t) defined as in (4.2). Note that 



A*(r) ^ 



1 



1 



h + h 



; u- A> ^y,,jC 



S«V2 / E 



1 



h + h 



; u- A> 



fiT)=w,dfiT)=y,d^f{T)=z 



h{w, y, z)dwdydz 
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Plugging in (4.26), we have that 



A*(t) = (l+o(l)Kexp<|-«72 + «/.,(T)--/.^(T) 



X J 7„(u- A) X expj - ^A + wB+ ^Tr(z + /x<^(T)/ + A/u<,(r)) 

+f^^,,{T) + i|a/x,(T)|2 + + \z\^+w)y{w,y,z)dwdydz, 

where h is the density function of (/(r), d f {t) , d"^ f (t)) under the measure P. The 
above display also uses the fact that both A and B are functions of {w,y,z) and 
therefore can be pulled outside of the conditional expectation. The notation 



(4.27) 



7„(a;) = E 



K + ©(e-'^'^'+^^e^^^Plft*)!) 



w,y,z 



where the expectation is taken with respect to the process g{t). Note that 1^ z = 
Tr{z). Plugging in the analytic forms of h (Lemma 5.7) and B as in (4.20) and 
moving all the constants out of the integral, we obtain that 

A*(r) 

= (l+o(l))uV"'/^+"'''('"^-5'"'(^^+5^^''('"<'^^^^+'^'"'('"^^+5l^'^'^^^l'+^^^ 

ir|-V2 



J| iLiKa+2) /^^"("'^^ exp|-^A+ ^l'^5 + y^9Ai^(T)| 



(27r) 

X exp I -ku~^y + l/af H22{u-^Y + 1/a) 



y y - 



1 — /^20/^22^M02 



X exp {u-^/2+*0 + \z\^ + w) } dwdydz. 
We insert 

-liu-'Y + l/aft,22{u-'Y + 1/a) = -^1^^221 + WO(|y|2 + 1) 
into the above display. With some elementary calculation, we obtain that 
A*(t) 

= (1 +o(l))w'^e""'/^+"'^"^'")"5''-('")+5^'^''(''-('")^+^'""(^))+l^'^-(^)l^+^^^ 
' ^(1+!kI.) / luiu-A)e^p\-'^A + u-'/'+'0{\y\' + \z\'+w + l) 



{2n)' 
X exp ■ 



l^^2 



\y-diJ,a{T)\ 



2 , (W - ;U20/"22 ^) 



-1/2- _ 1/2 
^22 ^ ~ ^^22 



2(7 



1 — M20M22^M02 

Furthermore, on the set £, according to the definition of A in (4.19) and 

w = A/a + 0{u-'/^+'\y\)+oil), 



,1 



dwdydz. 
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we obtain that 



A*(r) 



(1 _^0(l))yrfg-«V2+«A'<.M-i/x^(T)+5LTr(/.„(T)/+AM<,(T)) + |9M.M|^+i^^ 

' ^cf.!)!.) / Juiu-A)e^p{-^A + u-'/'+'0{\y\' + rz\'+A)] 
[it) 4 Jc I ) 



(27r) 



X exp< — 



\y-diia(T)\ +^ 



1 — M20M22'^M02 



1/2- 1/2 



M22 ^ ^22 



2cr 

2,1 



dwdydz 



(1 + o(l))u'^-ie-5("-''<'M)'+5^'^''('""'(^)^+'^''<'M)+l^''<'MI'+^^ + ^ 3««c(0) 
^ y« ((a + o(1))a) X exp {-i + w- Wo + j^p + ^) } 



(27r) 



(d+l)(d+2) 



X exp 



1 
2 

+ 



|y-5/x<,(T)| 



(i/n + 0(«-V2+^|y|) + 0(1) - ^20M2"2 



1 — M20M22^M02 



-1/2- 1/2 1 
M22 ^ M22 ^ 



dAdydz. 



The last step changes the integral from "dwdydz" to "dAdydz'\ where A — uA/a. 
Thanks to the Borel-TIS inequality (Lemma 5.1), Lemma 5.3 and the definition of 
K in (4.24), for a; > 0, 7u(a;) is bounded and as 6 ^ 00, 



7„(a;) = E 



(27r) 



-(i/2 



Note that on the set C, A > -u^/^+e gy Lemma 5.8, for -u^/'^+^ < x < 0, we 
have that 

luix) < e«''^ 

Therefore, 

7„(a;)/(a;^0,a;>-«3/2+-) 
(4.28) = I{x > 0) ((27r)-'^/2 ^ ^^^^j ^ /(-u3/2+^ < a; < 0)0 (e'*'*^) . 

The above approximation of 7u(a;) and the dominated convergence theorem (applied 
to the region where A > 0) imply that 



/oo 
-w 



, A\ -A , A 1 + 0(1) 

7„04) X e dA= I ' 



~^dA- 



1 + 0(1) 
(27r)'^/2 ■ 
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Then, we continue the calculation of A* (r) and obtain, by the dominated conver- 
gence theorem and the above results, that 



A(r) 



(4.29) 

: (l + o(l))A*(r) 



ir|-i/2 



(27r) 
exp 



(d+l)(d+2) 



I{A > 0) _^ 
(27r)'i/2 ^ 



|y-a/i,(T)|2 + 



I 



M22 



1/2. 



1/2 



M22 



2cr 



dAdydz 



The integrand factorizes. Then, we integrate out dA and and obtain that 



ir|-i/2 /• f 1 

2 



^ (£i+l)(d+2) / ^-^P ' 

(27r)^ — -i — J2eijrf(<i+i)/2 



|Ai20Ai22^^P 



+ 



-1/2- 1/2 1 
M22 ^ ~ A*22 ^ 



1 — A'20A'22^M02 

Thus, we conclude the situation when r is at least u~^^'^~^^' away from the boundary. 

The case in which t is close to the boundary of T. For the case in which r 
is within u^^^^^^ distance from the boundary of T, Lemma 5.9 establishes that 
the contribution of the boundary case is ignorable. An intuitive interpretation of 
Lemma 5.9 is that the important region of the integral / e^^*^dt might be cut off 
by the boundary of T. Therefore, in cases that r is too close to the boundary, the 
tail J e^^*^dt is not heavier than that of the interior case. 

Summary. Note that (r) does not achieve the its maximum at the boundary 
of T. Together with (4.29) and Lemma 5.9, we obtain that 



dz. 



f^'Ut>b] = E« 



dP 
dQ 

A(r)dT= (l + o(l)) / A*{r)dT 



(1 + o{l))u''-' H{i^, a, t) exp I - ^ (« - ii,{r)f | dr 



where 



H{ij,,a, t) 

|r|-V2 

((i+l)(ci+2) 



(27r) 

L 



exp • 



8(t2 



X / exp ■ 

/5gfld(<i+l)/2 



|M20/X22^^I^ 
1 — M20M22^M02 



-1/2- 
/^22 ^ 



1/2 



/^22 



2cr 



dz. 
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5. LemmEis. In this section, we state all the lemmas used in the previous 
section. To facilitate reading, we move several lengthy proofs to the supplemental 
article [41]. 

The first lemma is known as Borel-TIS lemma, which was proved independently 
by [16, 60]. 

Lemma 5.1 (Borel-TIS). Let f{t), t gU, U is a parameter set, be mean zero 
Gaussian random field, f is almost surely bounded on U. Then, 

E{supf{t)) < DO, 
u 

and 

P(max / {t) - E[max f (i)] > b) < e ^'u , 

where 

= max Far [/(*)]. 

Lemma 5.2. For each £ > 0, let Cq be as defined in (4.9). There exists some 
A > 0, such that 



eQ 



1 



/^exp{(u -/.<,(*))(/(*) + Ma(t)) + |M^(t)}rfi'iT ' ^ 

where Cq is the complement of set Cq . 



o(l)e-"^-"^"\ 



Lemma 5.3. Let ^„ be as defined in (4-18), then there exists a A > such that 
for all X > 

P(u'/'-''\Cu\>x)<e-'^'+e-'^\ 
for u sufficiently large. 

Proof of Lemma 5.3. We split the expectation into two parts {151 < u^} and 
{\S\ > u\t+ {uI - z)-i/2^ g T). Note that l^l < ku^ and g{t) is a mean zero 
Gaussian random field with Var{g{t)) = 0(|t|^). A direct application of the Borel- 
TIS inequality (Lemma 5.1) yields the result of this lemma. □ 

Lemma 5.4. Let S be a random variable taking values in {s : {ul — z)~^/^s + r e T} 
with density proportional to 

exp - {ul - z)-V2y)^ - {ul - z)-i/2y) I . 

Then, on the set C 

logji^exp (J53 ((m/-z)-5S') +cr(M-Ai^(T))C4 ((it/-z)-5S') +cri?((M/-z)-55) I 
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where the expectation is taken with respect to S as in (4.15). 

Lemma 5.5. Let I3 be as defined in the Part 2 of the proof of Theorem 3.4- On 
the set jC, there exists some 5* > such that 

X expj -A-uB- ^Tr{Af{T) + /.,(r)7 + Am<.(t)) - y'^dfi^ir) - l\dn^{ 
+^-^/^+^0(M^ + |.p + /(r))|. 
Lemma 5.6. 

log(det(/ - w"^z)) = — u"^Tr(z) + ^u-%(z) + o(u"^), 

where Tr is the trace of a matrix, 12(2) = eigenvalues of 

z. 

Proof of Lemma 5.6. The result is immediate by noting that 

d 

det(/-u-^z) = J|(l-Ai/it), 

i=l 

and Tr(z) = ^ti ^i- ° 



Lemma 5.7. For the homogeneous Gaussian random field f{t) in Theorem 3.4, 
let h{w,y,z) he the density of {f{T), dfij), d'^f{T)) evaluated at {w,y,z). Then, 



|r|-5 f 1 

(5.1) h{w,y,z) = (d+i)(d+2) exp 

(27r) 4 



y y+ ri +Z ^22 2 

i — M20M22 M02 



2 

where T is the covariance matrix of {f{T),d'^f{T)) whose inverse is 



I -M20M22^ ,,-1 

1— M20M22 A^02 



~M20M22 



M20M22 ,, — 1 I ^22 A'02A'20A'22 

-1.. P22 "T i_ 



Proof of Lemma 5.7. The form of (5.2) results from direct application of the 
block matric inverse of linear algebra. Note that 

1 1 f 1 /r~^ 0\ 

h{w,y,z)= ^ |r|-gexp<^ --(w,^"^,^"^) (u;,i"^,y"^)"^ 



(d+i)(d+2) 1^ I --K^ 9^ ' M n /■ 
By plugging in the form of F"^, we get the conclusion. □ 
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Lemma 5.8. Consider that : |t-r| < C T. Let 7„(a;) be as defined 

in (4-27). There exists some S* > such that for allO < x < 



lui-x)<e-^ \ 

Lemma 5.9. For each that t within u~^^'^~^^ distance from the boundary ofT, 
that is, there exists an s such that \s — t\ < and s ^T, we have that 



e9 



dP 



J e^^'^+^f'-'^dt>b,CQ 



0{l)u'^-^e-^ 



i (r))^ 



SUPPLEMENTARY MATERIAL 

Proofs of several lemmas in Section 5 and the numerical results 
(doi: .). This supplement contains proofs of Lemmas 5.2, 5.4, 5.5, 5.8, and 5.9 as 
well as numerical results. 



REFERENCES 

[1] R.J. Adler. The Geometry of Random Fields. Wiley, Chichester, U.K.; New York, U.S.A., 
1981. 

[2] R.J. Adler, J.H. Blaiichct, and J.C. Liu. Efficient simulation for tial probabilities of gaussian 
random fields. In Proceeding of Winter Simulation Conference, 2008. 

[3] R.J. Adler, J.H. Blanchet, and J.C. Liu. Efficient monte carlo for large excursions of gaussian 
random fields. Preprint, 2009. 

[4] R.J. Adler, P. MuUer, and B. Rozovskii, editors. Stochastic Modelling in Physical Oceanog- 
raphy. Birkhaiiser, Boston, 1996. 

[5] R.J. Adler, G. Samorodnitsky, and J.E. Taylor. High level excursion set geometry for non- 
gaussian infinitely divisible random fields, preprint, 2009. 

[6] R.J. Adler and J.E. Taylor. Random fields and geometry. Springer, 2007. 

[7] R.J. Adler, J.E. Taylor, and K.J. Worsley. Applications of Random Fields and Geometry: 
Foundations and Case Studies, preprint, 2009. 

[8] S.M. Ahsan. Portfolio selection in a lognormal securities market. Zeitschrift Fur 
Nationalokonomie- Journal of Economics, 38(1-2):105-118, 1978. 

[9] J. M. Azais and M. Wschebor. On the distribution of the maximum of a gaussian field with 
d parameters. Annals of Applied Probability, 15(lA):254-278, 2005. 
[10] J. M. Azais and M. Wschebor. A general expression for the distribution of the maximum of a 
gaussian field and the approximation of the tail. Stochastic Processes and Their Applications, 
118(7):1190-1218, 2008. 

[11] J. M. Azais and M. Wschebor. Level sets and extrema of random processes and fields. Wiley, 
Hoboken, N.J., 2009. 

[12] S. Basak and A. Shapiro. Value-at-risk-based risk management: Optimal policies and asset 

prices. Review of Financial Studies, 14(2):371-405, 2001. 
[13] S. M. Bermaii. An asymptotic formula for the distribution of the maxiiimiii of a gaussian 

process with stationary increments. Journal of Applied Probability, 22(2):454— 460, 1985. 
[14] F. Black and M. Scholes. Pricing of options and corporate liabilities. Journal of Political 

Economy, 81(3):637-654, 1973. 

[15] J. H. Blanchet, J. Liu, and X. Yang. Monte carlo for large credit portfolios with potentially 

high correlations. Proceedings of the 2010 Winter Simulation Conference, 2010. 
[16] C. Borell. The Brunn-Minkowski inequality in Gauss space. Inventiones Mathematicae, 1975. 
[17] C. Borell. The Ehrhard inequality Comptes Rendus Mathematique, 337(10) :663-666, 2003. 



26 LIU AND XU 

[18] M. J. Campbell. Time-series regression for counts - an investigation into the relationship be- 
tween sudden-infant-death-syndrome and environmental-temperature. Journal of the Royal 
Statistical Society Series a-Statistics in Society, 157:191-208, 1994. 

[19] N. Chamandy, K.J. Worslcy, J. Taylor, and F. Gossclin. Tilted culcr characteristic den- 
sities for central limit random fields, with applications to 'bubbles'. Annals of Statistics, 
36(5):2471-2507, 2008. 

[20] K. S. Chan and J. Ledolter. Monte-carlo em estimation for time-series models involving 
counts. Journal of the American Statistical Association, 90(429) :242-252, 1995. 

[21] G. Christakos. Random field models in carili sciences. Academic Press, San Diego, 1992. 
[22] G. Christakos. Modern spatiotemporal geostatistics. Studies in mathematical geology. Oxford 
University Press, 2000. 

[23] D. R. Cox. Some statistical methods connected with series of events. Journal of the Royal 

Statistical Society Series B-Statistical Methodology, 17(2):129-164, 1955. 
[24] D. R. Cox and Valerie Isham. Point processes. Monographs on applied probability and 

statistics. Chapman and Hall, London ; New York, 1980. 
[25] R. Daley. Atmospheric data analysis. Cambridge atmospheric and space science series 2. 

Cambridge University Press, Cambridge ; New York, 1991. 
[26] R. A. Davis, W. T. M. Dunsmuir, and Y. Wang. On autocorrelation in a poisson regression 

model. Biometrika, 87(3):491-505, 2000. 
[27] A. Dembo and O. Zeitouni. Large deviations techniques and applications. Springer- Verlag. 

New York., 1998. 

[28] H. P. Deutsch. Derivatives and internal models. Finance and capital markets. Palgrave 

Macmillan, Houndmills, Basingstoke, Hampshire ; New York, N.Y., 3rd edition, 2004. 
[29] D. Duffle and J. Pan. An overview of value at risk. The Journal of Derivatives, 4(3):7-49, 
1997. 

[30] D. Dufresne. The integral of geometric brownian motion. Advances in Applied Probability, 
33(1):223-241, 2001. 

[31] P. Glasserman, P. Heidelberger, and P. Shahabuddin. Variance reduction techniques for 

estimating value-at-risk. Management Science, 46(10):1349-1364, 2000. 
[32] J. R. Gott, D. C. Hambrick, M. S. Vogeley J. Kim, C. Park, Y. Y. Choi, R. Cen, J. P. 

Ostriker, and K. Nagamine. Genus topology of structure in the sloan digital sky survey: 

Model testing. Astrophysical Journal, 675(l):16-28, 2008. 
[33] M.S. Handcock, A.E. Raftery, and J.M. Tantrum. Model-based clustering for social network. 

Annals of Applied Statistics, 170. 
[34] S. R. Hanna and J. M. Davis. Evaluation of a photochemical grid model using estimates of 

concentration probability density functions. Atmospheric Environment, 36(11):1793— 1798, 

2002. 

[35] P. D. HofT, A. E. Raftery, and M. S. Handcock. Latent space approaches to social network 

analysis. Journal of the American Statistical Association, 97(460):1090— 1098, 2002. 
[36] Jiirg Hiisler. Extreme values and high boundary crossings of locally stationary gaussian 

processes. Annals of Probability, 18:1141-1158, 1990. 
[37] Jiirg Hiisler, Vladimir Piterbarg, and Yueming Zhang. Extremes of gaussian processes with 

random variance. Electronic Journal of Probability, 16(45):1254— 1280, 2011. 
[38] H. J. Landau and L. A. Shepp. Supremum of a gaussian process. Sankhya-the Indian Journal 

of Statistics Series A, 32(Dec);369-378, 1970. 
[39] M. Ledoux and M. Talagrand. Probability in banach spaces : isoperimetry and processes. 

1991. 

[40] J. Liu. Tail approximations of integrals of gaussian random fields. Annals of Probability, to 
appear, 2011. 

[41] J. Liu and G. Xu. Supplement to "some asymptotic results of gaussian random fields with 

varying mean functions and the associated processes". DOI:, 2011. 
[42] M. B. Marcus and L. A. Shepp. Continuity of gaussian processes. Transactions of the 

American Mathematical Society, 151(2), 1970. 



SOME ASYMPTOTIC RESULTS OF GAUSSIAN RANDOM FIELDS 



27 



[43] R. Merton. The theory of rational option pricing. Bell Journal of Economics and Manage- 
ment Science, 4:141-183, 1973. 

[44] Y. Nardi, D. O. Sicgmund, and B. Yakir. The distribution of maxima of approximately 
gaussian random fields. Annals of Statistics, 36(3): 1375— 1403, 2008. 

[45] V. I. Piterbarg. Asymptotic methods in the theory of Gaussian processes and fields. American 
Mathematical Society, Providence, R.I., 1996. 

[46] D. Rabinowitz and D. Siegmund. The approximate distribution of the maximum of a 
smoothed poisson random field. Statistica Sinica, 7:167-180, 1997. 

[47] Y. Rubin. Applied Stochastic Hydrogeology. Oxford Univ. Press, New York, 2002. 

[48] K. Shafie, B. Sigal, D. Siegmund, and K. J. Worsley. Rotation space random fields with an 
apphcation to fMRI data. Ann. Statist, 31:1732-1771, 2003. 

[49] D. Siegmund. Importance sampling in the Monte Carlo study of sequential tests. Ann. Stat, 
4:673-684, 1976. 

[50] D. Siegmund and B. Yakir. Tail probabilities for the null distribution of scanning statistics. 

Bernoulli, 6(2): 191-213, 2000. 
[51] G. Snioot and K. Davidson. Wrinkles in time. W. Morrow, New York, 1993. 
[52] T.A.B. Snijders. Markov chain monte carlo estimation of exponential random graph models. 

Journal of Social Structur, 3, 2002. 
[53] M.L. Stein. Interpolation of Spatial Data: Some Theory for Kriging. Springer series in 

statistics. Springer, New York, 1999. 
[54] V.N. Sudakov and B.S. Tsirelson. Extremal properties of half spaces for spherically invariant 

measures. Zap. Nauchn. Sem. LOMI, 45:75-82, 1974. 
[55] J. Y. Sun. Tail probabilities of the maxima of gaussian random-fields. Annals of Probability, 

21(1):34-71, 1993. 

[56] M. Talagrand. Majorizing measures: The generic chaining. Annals of Probability, 24(3):1049— 
1103, 1996. 

[57] J. Taylor, A. Takemura, and R. J. Adler. Validity of the expected eulcr characteristic heuristic. 

Annals of Probability, 33(4):1362-1396, 2005. 
[58] J. Taylor and K. J. Worsley. Random fields of multivariate test statistics, with an application 

to shape analysis. Annals of Statistics, 36(l):l-27, 2008. 
[59] J. E. Taylor and K. J. Worsley. Detecting sparse signals in random fields, with an application 

to brain mapping. J. Amer. Statist. Assoc., 479:913-928, 2007. 
[60] B.S. Tsirelson, LA. Ibragimov, and V.N. Sudakov. Norms of Gaussian sample functions. 

Proceedings of the Third Japan-USSR Symposium on Probability Theory (Tashkent, 1975), 

550:20-41, 1976. 

[61] K. J. Worsley and J. E. Taylor. Detecting fMRI activation allowing for unknown latency of 
the hemodynamic response. Neuroimage, 29(2):649-654, 2006. 

[62] E. P. Xing, W. J. Fu, and L. Song. A state-spa<;e mixed membership blockmodel for dynamic 
network tomography. Annals of Applied Statistics, 4(2):535-566, 2010. 

[63] M. Yor. On some exponential functionals of brownian-motion. Advances in Applied Proba- 
bility, 24(3):509-531, 1992. 

[64] S. L. Zeger. A regression-model for time-series of counts. Biometrika, 75(4):621-629, 1988. 



SOME ASYMPTOTIC RESULTS OF GAUSSIAN RANDOM FIELDS 



1 



Supplement to Paper "Some Asymptotic Results 
of Gaussian Random Fields with Varying Mean 
Functions and the Associated Processes" 

By Jingchen Liu* and Gongjun Xu 
Columbia University 



This supplement contains proofs of Lemmas 5.2, 5.4, 5.5, 5.8 and 5.9 and a subsection 
containing numerical results to illustrate the approximation results in Section 3. 



A: Proofs of Lemmas 

Proof of Lemma 5.2. Note that 



'MT) It 



mes(T) Jt mes(T) 



implies that for large b, 



^ / exp\{u- ti^{t))-{f{t)+ij.^{t)) + li^l{t)]dt 

mes{T) Jt I 2 J 

^^pj^^^^'^^Wj ^-77j^ f exp|(u-max/ia(t)) (/(t)+Mo-{t))|dt 



+ 



Tn{/(t)+M<T(t)<0} 



/Tn{/(t)+M„{t)>0} 
exp i I u — mill ^^a(t] 



teT 



dt 



By Jensen's inequality, the above display is 



1 



1 



> - exp < - mill ri„ (t) > — - 1 

> exp {u^ — ciulogu — C2} , 



(u-maxtgT- licit)) /a 



where ci and C2 are some constants. The last step of the above display uses the fa<;t 
that u — log 6 = O(logu). 
Then for any £ > 0, 



e9 



/j, exp {{u-IXa {mm + Ma (t)) + 1 1^1 (t) }dt'JT 



J e'^(')+'"^(*)dt > 6,|/(t) -«| > 



/2+s 



"^e^C^) " L It exp ({« - • if(t) + M<T(t)) + ^f^lit)) dt' 

f e''W+-/(')dt > -^b, |/(r) - «| > «V2+." 
mes(T) Jt mes(T) 

< exp {-u^ + ciulogw + C2} Q (|/(t) -u\> u^/^+^|r^ 



o(l)e- 



^■"Research supported in part by Institute of Education Sciences, through Grant R305D100017, 
NSF CMMI-1069064, and NSF SES-1123698 
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Similarly, we can get 



E? 



/j, exp {{u-fia (t)) (/(t) + Ma (*)) + i l^i (t) )dt' Jt 



1 — ^ / e' ^ ' - ~ 'at ^ o.ji^n 



:o(l)e-"'-"'+\ 



Proof of Lemma 5.4. For <5 > e, we first split the expectation into two parts: 

E [exp|(Tg3 ({ul -z)'hs^ + a{u - ii„(t))C4 - z)"5s) + aR ((u/ - z)" 3 |] 

= Jl+ J2- 

Let t = {ul — z)~ 2 s. Given that C(t) is a monotone non-increasing function, we have 
that for all \s\ = 0{u^) 

-|(. - K - z)-V2y)^ _ („/ - z)-l/2^) 

+Crp3 (jul — z)~5s^ + a{u — Ha{T))Ci {{ul — z)~5s^ + cril ^(u/ — z)~5s^ 
= (t - («7 - z)-/2j/)'' («7 - z) (t - («7 - z)-V2j,) 

+o-33(<) + cr(u - iJ.a{T))C4,{i) + aR{t) 
< -\u\tf = -As^. 

Therefore, for A' small 

J,=0(e-^'""). 

We now consider the leading term Ji. One the set that \S\ < and \y\ < u^/2+^, 
we have that 

0-93 ((M/-z)-5S)+cr(u-M^(r))C4 ((u/-z)-5S)+CTi?((u/-z)-5S) = O (u-^+'^^^ . 

By using Taylor's expansion twice, we can essentially move the expectation into the 
exponent and obtain that log Ji equals 

E [0-93 ((m/-z)-55) + a{u - HcriT))C4, ((u7-z)-55) +CTil((u7-z)-5s) ;|5| < u*]+o(u-i) . 

Note that (ul - z)"l/2y = u-l/2y + 0(M"'^/2|y||z|) and y = y + 0(1). Let Z = 
(Zi, Z^) be a multivariate Gaussian random vector with mean zero and covariance 
function cr^^I. Then, S is equal in distribution to Z + u~^^^y + 0{u~^/'^\y\\z\). 
Therefore, wc obtain that 



(T + 0(«-i+=) 

U ' ' 

ijkl 

(T + 0(U-1+^) _i 



-u 

24 

ijkl 



ijkl 

J2 dfjklC{0)E [{u-'/^yi + Zi){u-^/\ + + Zfc)(«-i/2y, + Zi] 



_%-3/2 ^ a4;,,c(o)E + . + z,)(«-i/2y, + z,) 



ijkl 



yi 
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where the expectations are taJjen with respect to Z. Then 
log Ji 



ijhl 



Y.d%klC{0)yiyiykyi - \u-^'^Y.^at^f,l^{Q)u-^'^ykyi 

ijkl iikl 



iikl an 

= - ^ E df,uC{0)yiyjykyi - E dtikiC{0)u-^/^ym + ^ E 9fiiiC{0) + o {v 

ijkl iikl an 

= -^^"'^-^-i^'^'-i + iE^-^w 

= -^(u-'Y - l/a)T^22(„-iy - 1/a) + ^l^M22l + ^ E ^iiii^W + ° ■ 



Proof of Lemma 5.5. Similar to the derivations of the leading term I2 in Part 2 of 
Theorem 3.4 proof, such as (4.22) and (4.23), we can obtain that 

h = 0(l)e"""PlsWldet(u/-z)-i/2ii-d/2 

xexp|(« + a) (^f{T) + ^y'^{uI-i)-''y^^ 

X / exp|-iU-(« + G)i/2(«/-z)-i/2^|'| 

X exp|(u + C„)93 ((« + Cu)-'/^(«/ - z)"'/^s) 

+ w({i + a)C4 ((« + C«)"^''^(w^ - z)-i/2s) jds 

Note that < «i/2+£ ^ ui/2+^ = ^Xu- Therefore, there exists a 5* > such that 
the integral on the right-hand-side of the above display is 

/ , , exp|-i|s-(« + C„)i/'(«/-z)-i/'^|'j 

X exp|(« -t- Cu)93 ((« + - 

+ u{u + Cu)Ci ((it + Cur'^^'^iul - z)-^/^s) jds 



Proof of Lemma 5.8. To simplify the notation, let r = 0. For other values of r, the 
derivation is completely analogous. Recall that 



lu{-x) 



< i? -a;>€„|/(r),a/(r),a2/( 



; -a; > ?u 



f(T),df{T),d^f(T) 



We use the notation E^^y^i[-] to denote E [•|/('r) = w,df{T) = y,d^f{T) = i] and 
Pw,y,z to denote the conditional probability. 
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Note that r r / n -, n 

= E l^exp |g {{ul - z)-i/25j |J , 

where 5 is a random variable with density proportional to (4.16). Therefore, 

if and only if 

Ai = E[exp{g({«/-z)-i/2s)};|S| <«^] , 



where 



Furthermore, we have that 



log^i < sup g(s), 

|s|<u-V2+5 



and for A and A' sufficiently small 



< Pw,y,s I sup gis/V^) - > -Xu^l ] < e-^'"' < e"^'"''' 



for all < X < M^/z+e Therefore, 



^; u- sup g{s) + o(u-e ^"^'')>a; 
|s|<u-i/2+5 ^ ^ 



exp O I M • sup \g{s) 

lsl<u-l/2+5 



« • sup 

|s|<u-l/2 + 5 



p g(s) + o(«-e-^"'') >, 
1/2+5 ^ ^ 



By the Borell-TIS inequality (Lemma 5.1), we have that 



P [ u ■ sup g(s) > X ] < e 

|s|<u-l/2+« / 

Therefore, with S* small enough, we have that 

For the remainder term, 

E.uj,y,s [k-^ Ai + A2 > e'^/'',A2 > e-^"' 
< S^.g.s [k"^ A2 > e-^"^ 



< e" 



K ^; sup g{s/\/u) > —\u^^ 



En, 



2S 



sup g{s/\/u) > —Xw 



sup g{s) s > —An 

seT,|s|>u-l/2+5 2 
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Let St be the global mEiximum of g(s)— in the region {s : s S T and |s| > W 

-1/2+5}, 

In what follows, we provide an upper bound of E ^k~^ \ sup^^^ |^|^^_i/2+5 g(s) — > 

Note that for each s« 6 T, |s»| > we proceed to describing the conditional 

distribution of g{t) given g{s*) — > —Xv?^. Recall that g{t) is the remainder of 
the /(t) after the first two order expansion. Therefore, we have 

f(*) = Yl ^>,j,fc*i*j*fe +Op(l*l^)' 

where Zi jj^ jointly follows a multivariate Gaussian random distribution with mean 
zero and nondegenerate covariance. Then, git) approximately takes a form of a cubic 
polynomial. Therefore, given g(s«) — > —\v?^, we have approximation 



0^{u\tf\s,\-^). 



ds 



We write X„ = 0{an) if Mn{0) = B(e^'^"/"") in bounded uniformly of 6 in a domain 
around zero. The above result can be obtained by repeatedly using the Borell-TIS 
inequality (Lemma 5.1) and we omit the details. Thus, for \y\ < u^/^+^ and given 
ff(s«) — > — Au^^, we have the approximation 

ug (u-^y) = Op . 

We choose Se < <5 and some C > sufficiently large so that 

K = [ exp|-i|s-(w + Cu)'/'(«/-z)-i/2j/|H 

xBexp + (iu)g ((« + C«)"'/^(«-r - i)-i/^5) } 

> 8(1)/ exp{-C|s-y|2 + 0(ufl(s/«))}(is 

> 6(1) A exp{-C|s- j(|2 + 0(«g(s/M))}(is 

J\s-y\<l 

> e(l) / exp|-C|s-jf|' + 0(«i+3--'')|ds 

> eOW, 

where the 0{u) in the last step could be negative. Then, 

<eOW. 



(5.3) 



sup 

seT,|s|>'u-l/2+« 



g{s) > -\u^ 



Therefore, for all < a; < u^''^+^, we obtain that 



sup 

seT,|s|>u-l/2+« 



g{s) > -Au^ 



Proof of Lemma 5.9. Similar to the interior case, we proceed by conditioning on 

ifir),dfiT),d^f{T)) and consider 

mes(r)e"'/2E [K-^;£t,C\ /(r) = w,df{T) = y,d^f{T) = z] . 
We perform a similar analysis as in Parts 1 and 2 in the proof of Theorem 3.4. 
Therefore, we will omit most details. With a similar analysis as I\ in (4.15) and 
(4.17), we obtain that 



L 



;'^{/(t) + ("-M<TM)C(t-T)+M<,(t)}^J > 5 

T 
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if and only if 



Jiul-Z.) 2 



' cr \d/2 



where A and are as defined in (4.19) and (4.18). Note that if t is in the interior, 
the second term on the left-hand-side of the above inequality is o{u~^); if r is close 
to the boundary, this term may take a negative value. This is because part of the 
important integration region lies outside of set T. 

Now we consider the K term. According to the derivations in Part 2, we obtain that 
K = (l + o(l))u-''e"^-"''<'M+5''^W 



X expi - A -uB- -^Tr{Af(T) + ix^ir)! + Aij.„{t)) - y'^d^^ir) - I [^^^(t)!^ 

a 2(7 1 

+«-l/2+^0(|2/p + N^ + /(r))} 

X / exp|-i|s-(« + G)i''^(«/-z)-i/2jf|'].ds 

xBexp [{u + Cu)g {{u + Cur'/\ul - z)-i/25') } . 
Therefore, 

E?\^; f ei'(*^+''f^*'>dt>b,CQ 
idQ Jt 

= 0(1) J e"^/''E[K-'';eb,C\f{T) = w,af{T) = y,d''f(T) = z]h{w,y,z)dwdydz. 

With similar derivations as in Part 3 and letting Eto,^,z(-) = E{-\w,y,z), we obtain 
that 

'dP 



(5.4^« 



dQ 



0(l)«''e-5("-'''(^))^ 



/ ( / exp(-i|s-(« + C«)i/2(ii7_2)-i/2|;|'\d5 



XE, 



Ecxp{(u + Cu)g {(u + a)-i/2(«/ - z)-i/25')} ' 
A + log/ , (^Y^\-ii^-^-'-'r^^'^yl^as>u-% 

V{u/-z) 2s+TST^27r/ 

exp |-^A + «-V2+«0(|y|2 + + |^|)| 
\y - dfj.^{T)\'' 



X exp 



,2 , {A/a + O{u-^/^+^\y\) + o{l)-H20H2i^)^ 



1 — i"20A'22 M02 



1/2- 1/2 



A'22 ^ /^22 



2o- 



^ dwdydz 



There arc two terms whose analyses are different from those of the interior case: 



(5.5) / 



exp 

(ti/-z)-l/2s+TST L 2 



ds 



and 
(5.6) 



J(uI-2)~2 s+tCT ^'i'K-' 



e-2'°-y"-'-'-i »i ds. 

(uJ-z)~ 4 s+tGT 

This is mainly because the main integration region may lie beyond the region T. We 
bound the above two integrals in the following two cases. 
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Case 1. We consider the set Ri = {y : t + {ul — i)~^y 6 T}. 
Case 2. We consider the set R2 = {§ ■ t + {ul — i)~^y ^ T}. 

For the first case, r + {ul — i)~^y 6 T. Note that the integrands of (5.5) and (5.6) 
are approximately Gaussian densities. Since t + {ul — i)~^y 6 T, there exists So so 
that 

f exp|-^ |s-({i + C„)'''^(«-f-z)-i/2yr].ds>(5o. 

In addition, (5.6) < 1. Therefore, 



< 0(l)u''e"2 



)-l/2(c7_i)-l/2s/);^>" 



Se(«+C")9((«+C-)-'^''(0-r-2)-i/2s') ' 
exp \--A + u-i/2+«o(|y|2 + + |,„|)| 



X exp 



{-I 



\y-dlJ,a{T)\ 



2 , (A/^ + O(n-i/2+-|y|) + o(l)-M20M22'i)2 



1 — IJ'20lJ-22 1^02 



+ 



l/2;_ , l/2_ 



^22 ^ f^22 



2a 



dwdydz 



0(l)^^'*-le-5("-''''(^"^ 



The last step uses similar arguments as in those in Part 3, such as dominated con- 
vergence theorem. Thus, we conclude Case 1. 

For the second case r + {ul — x)~^y ^ T, since t € T and T has piecewise smooth 
boundary, the integral in (5.5) has lower bound 

/ exp |-i Is - (ii + Cuy/''{ul - i)-''/^yf]ds 

yti-i/2(a/_i)-i/2s+.reT 12 1 I J 

= e(i)/ .^exp(-"^(^ + "(""^^^"^))| 

it+TST [ 2 I 

= e(i)p(z>(i + o(«-i/2+-))|y|) 

= min.^e(l) — e ^ ^1^1 ,lL 

I 1^1 J 

We insert this result back to (5.4) and obtain that 

e«V2E[js:-i.£:j,£,R2] 

< 0(l)«'^e-i [ |j;|exp{i|jf|2} 

JC,R2 ^ 



xE,, 



1 



L£e("+C«)9((s+C>.)'^''"(a-f-2)-i/"S') ' 



J(ul-i.) 2 3+tST ^27r/ 



exp i + «-V2+^o(|^|2 + |5|2 + 1^1) 



/%-f|.-(«/-z)-V2j,|2 



X exp 



■{- 



^ (A/a + 0(«-l/2+e|^|) _^20M2"2 5)' 



1 — IJ'20 1^-22 1^02 



l/2=_ , l/2_ 



M22 ^ f^22 



2a 



^dwdydz. 
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Using to cancel the square term of \y — diJ,^{T)\'^ and the fact that \y\ < 

we obtain that 



'C,R2 



.£;e("+C")9(("+C«)"'''^("-f-2)-'/^S'') ' 

A + log f , (^f'e-i\'-(-'-'r^''y\'ds>u-^^^ 

J(ul-z.) 2 s + TeT ^■^T^' 



/(ti/-z) 

X exp •! - + 0( 



„l/2+25)l 



X exp 



(A/ a + 0(»-l/2+.|^|) + 0(1) _ ^2 0M22'^) 
1 — M20/"22^A'02 



l?^2 



-l/2-_ 1/2 
^22 ^ ^22 



2ct 



^ dwdydi 



We now proceed to handle the term in (5.6). Once again, since T + {ul — z) ^ T, 
there exists a cq > such that 

log/" , (^Y'\-i\^-^-'-^^-"'y\'ds<-c,. 

J(ul-T.) 2 s+rST \27r/ 

Therefore, 

/ e''(*)+'^«*)dt>6,£Q,il2' 
idQ Jt 

< 0(l)u'^e-5("-''<'M)^ 

.Ee("+C„)g((c+a)-i/=(«-S)-i/=S') ^ co 
:exp|-^A + 0(«i/2+25)| 

"(A/a + 0(«-V2+=|^|) + 0(1) - /.20M22'5)" 



exp 



1 — /i20M22^W2 



-1/2- 1/2 1 
IJ-22 ^ ~ ^22 ^ 



dwdyd 



The integral in the above display can be split into two parts, A> co/2 and A < co/2: 
first 



R2,A>co/2 



exp 



1 r (A/a + 0(«-l/2+e|^|) + 0(1) _ ^20/^22^5)2 



X exp 



1 — M20A»22^/*02 



-l/2-_ 1/2 1 
^^22 ^ ~ 1^22 ^ 



dwdyd 



0(1) / exp{-'^-"(A-co/2) + 0(«i/2+2*)| 

JC,R2,A>co/2 I 2a a J 



exp 



(A/o- + 0(M2e) + o(l) - IX20IJ.22Z) 



1?A2 



1 — IJ-20IJ,22 IJ-02 



+ 



-1/2- 1/2 1 
M22 ^ ^^22 ^ 



• dwdydz 
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and second (with a similar derivation as in the proof of Lemma 5.1 

1 



/ 



A > CO +u 



xexp --A + 0{«i/2+2^) 



exp < - 



(A/g + 0(»-V^+^|y|) + o(l) - M20M22 2) 
1 — A'20A'22^M02 

/ cxp 

1 [(A/a + 0(«-V2+.|^|) + _ ^20^2^5)2 



-1/2- 1/2 1 

^22 ^ ~ /^22 



exp-l-. , _i 

1 — /i20M22 M02 

= o(«-l). 
The last inequality results from the fact that 
1 



-1/2- ,1/2 



^^22 



/^22 



2fT 



dwdydz 



^ dwdydz 



: 0(l)exp{-A«2} , 



which can be derived by the bounds of straightforwardly. Thus, when r is within 
u~^^'^'^^ distance away from the boundary of T, we obtain that 



eQ 
e9 



} Jt 



dP 

dQ JT 

dQ Jt 

0(l)^^'*-^e-3("-''<'(^»^ 



■E? 



dP 



B: Simulation 






Fig 5.1. Comparisons of approximations in Theorem 3.4 and the estimated tail probabilities via 
5000 simulations on a log scale for the one- dimensional case. 
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Fig 5.2, Comparisons of approximations in Theorem 3.4 and the estimated tail probabilities 
5000 simulations on a log scale for the two-dimensional case. 



We conduct a simulation study to exam the accuracy of the approximations. In 
particular, we consider Gaussian processes Hving on a domain T = [—A,A]'^ with 
_ 

covariance matrix C{t) = e 2 and mean function fj,{t) = — |tp/4. Figure 5.1 
compares, on a log scale, the approximations in Theorem 3.4 with the tail probabilities 
computed using 5000 simulations for the one-dimensional case, that is, T = [—A, A]; 
Figure 5.2 is for the two-dimensional case, that is, T = The red dash 

line indicates our approximations and the black solid line indicates the Monte Carlo 
estimates of the probabilities 

One empirical finding is that the approximation sometimes overestimates the tail 
probability especially when the region T is relatively small (compared with u~^^^). 
This is because the asymptotic approximation is derived based on the heuristics 
in (3.7) so that Jye^^'^dt > fe is approximately equivalent to Jj^^ e"'-^^'^^ dt > b. 
However, for not so large a u (or equivalently b), for instance u < 4, the inter- 
vals [—1,1] and [—1,1]^ (the first plots of both figures) are not large enough (com- 
pared with M^^/^ = |). Therefore, the approximation in (3.7) is not accurate and 
f.j,efWdt < /^de"<^Wdt. This results in an overestimation of the tail. When the 
region T is larger, such as the second and the third plots in both figures, the approxi- 
mations are accurate. In many spatial analyses, the region T of interest is reasonably 
large. Therefore, we believe that the approximations derived in this paper provide 
reasonable estimates of the tail probabilities for a wide range of practical analyses. 
A practical guide to evaluate the appropriateness of the approximation is as follows. 
Let B{t,r) = {s : \s — t\ < be the r-ball around t. Define 

r(T) = sup{r : there exists a t such that B(t, r) C T}. 

That is, r(T) is the radius of the largest ball contained in T. Further, define 

p{T)= sup C(t)/C(0). 

\t\=r(T) 

The smaller the p(T) is, the larger the region T is (relative to the covariance function). 
For instance, for T = [—1, 1] and T = [—1, 1]^ (the first two plots in both figures). 



SOME ASYMPTOTIC RESULTS OF GAUSSIAN RANDOM FIELDS 



p(T) = e-i/2 = 0.61; for the other regions, the p(T)'s are all below 0.15. Therefore, 
the simulation study supports a practical guide that the approximations developed 
in the current paper provide good estimates when p(T) < 0.15. 



